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Introduction 



The study of the normahzed sum of random variables and its asymp- 
totic behaviour has been and continues to be a central chapter in probability 
and statistical mechanics. When those variables are independent the central 
limit theorem ensures that the sum with square-root normalization converges 
toward a Gaussian distribution. The main topic of this thesis is the general- 
ization of the central limit theorem for spin random variable whose interac- 
tion is described by a multi-species mean-field Hamiltonian. Ellis, Newman 
and Rosen in [EN 78 a] and [ENRSOj describe the distribution of the suitable 
normalized sums of spins for mean-field model a la Curie- Weiss. They have 
found the conditions, in terms of the interaction, that lead in the thermody- 
namic limit to a Gaussian behaviour and those who lead to a higher order 
exponential distribution. We prove analogous results for the multi-species 
mean-field model under the assumption that the Hamiltonian is a convex 
function of the magnetizations and the first non vanishing partial derivatives 
of the pressure functional are all the same order (homogeneity hypothesis). 
The extension to non convex interactions or the complete classification of 
the limiting distribution beyond the homogeneity hypothesis will be object 
of further investigations. 

The thesis handle other two problems concerning the multi-species mean-field 
model: the computation of the exact solution of the thermodynamic limit of 
the pressure and the solution of the inverse problem. 

The so called Curie- Weiss model |Wei07] has been introduced in 1907 by 
Pierre Weiss in the attempt to describe Pierre Curie's experimental observa- 
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tions of the magnetic behaviour of some metals such as iron and nickel at dif- 
ferent temperature (see |Cur95j ). These materials, after having been exposed 
to an external magnetic field develop a magnetization with the same sign of 
the field. Curie noted that when the field was then switched off the materials 
showed two different behaviours depending on the temperature at which the 
magnetization was induced. If the temperature was below a critical value 
the materials retained a degree of magnetization, called spontaneous magne- 
tization, whereas they was not capable of doing this when the temperature 
was greater or equal to the critical value. As temperature approached the 
critical value from below the spontaneous magnetization vanished abruptly. 

The multi-species mean-field model is a generalization of the Curie- Weiss 
model in which the particles are partitioned into an arbitrary number of 
groups. Both the interaction constant and the external field take different 
values depending on the groups particles belong to. Such models have been 
introduced since the 50s to reproduce the phase transition of some materials 
called metamagnets. In particular in |GvPT56llMot59llK+75j and |GYS98] 



a bipartite mean-field model is used to approximate a two-sublattice with 
nearest neighbor and next-nearest neighbor exchanging interactions. The 
same model has also been used to study the loss of gibbsianness for a system 
that evolves according to a Glauber dynamics |KLN07j . 
In recent times the general version of these models have been proposed in 
the attempt to describe the large scale behaviour of some socio-economic 
systems |CG07] . assuming that individual's decisions depends upon the deci- 
sions of others. Multi-species non-interacting spin models are at the basis of 
the so called discrete choice |McF01j theory used by the Nobel prize McFad- 
den to forecast the choice of some socio-economic agents. The extension of 
the discrete choice theory to the interacting case was first suggest in |Dur99] 
and |BD01j . The investigation of the model introduced in |CG07j has been 
pursued at a mathematical level in |GC08] . It has been shown the existence 
of the thermodynamic limit of the pressure exploiting a monotonicity condi- 
tion on the Gibbs state of the Hamiltonian (see |BCG03] ). The factorization 
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of the correlation functions has been proved for almost every choice of pa- 
rameters and the exact solution of the thermodynamic limit is computed 
whenever the Hamiltonian is a convex function of the magnetizations. The 
phenomenological test of the model has been started in [GBCOSj and it is a 
topic of current investigations. 

The thesis is organized as follows. In the first chapter we consider the 
general version of the mean-field model. At first we compute the exact so- 
lution of the thermodynamic limit following Thompson in |Tho88] . Then 
we present the results of Ellis, Newman and Rosen on the asymptotic be- 
haviour of the distribution of the sum of spins. Finally we discuss in detail 
the Curie- Weiss model. In particular we show that the critical phases can be 
evaluated probabilistically analyzing the distribution of the sum of spins in 
the thermodynamic limit (see jEN78b] ). 

Chapter two focus on the multi-species mean-field model. Firstly we 
compute the exact solution of the thermodynamic limit. We exploit a tails 
estimation on the number of configurations that share the same value of the 
vector of the magnetizations. This technique is the same used by Talagrand 
to compute the thermodynamic limit for the Curie- Weiss model |Tal03] . 
Secondly we analyze the limiting thermodynamic behaviour of the probability 
distribution of the random vector of the sums of spins of each species. In order 
to use the Ellis, Newman and Rosen method we consider multi-species model 
whose Hamiltonian is a convex function of the magnetizations. Under this 
assumption we show that, when the system reaches its thermodynamic limit, 
the probability distribution of the suitable normalized random vector of the 
sums of spins converges to a non-trivial random variable. The behaviour of 
this random variable crucially depends upon the nature of the maxima points 
of a function / associated to the model. If the function / admits a unique 
global maximum point and the determinant of its Hessian matrix computed in 
this point is different from zero, the suitable normalized random vector of the 
sums of spins converges to a multivariate Gaussian whose covariance matrix 
can be compute from the mean-field equations. If the function / admits a 



iv 



Introduction 



unique global maximum point in which the determinant of its Hessian matrix 
vanishes and the order of the first partial derivatives of / different from zero 
is homogeneous, the suitable normalized random vector of the sums of spins 
converges to an higher order exponential distribution. The order of this 
distribution is those of the first partial derivatives of / different from zero. 
When the function / has more than one maximum point we obtain a similar 
result whenever the random vector of the magnetizations is close enough to 
one of the maximum points. The proof of this last result is quite different 
respect those used to prove an analogous statement in [ENRSOj . The reason 
is that for the multi-species model the Legendre transformation is not a useful 
tool. We follows the proof used in |EW90] to compute a limit theorem with 
conditioning for the Curie- Weiss-Potts model. 

In the last chapter we solve the inverse problem for the Curie- Weiss model 
as well as for its multi-species generalization. The inverse problem is a proce- 
dure to obtain the parameters of a Boltzmann-Gibbs's distribution by know- 
ing average value and correlations of the spins at the thermodynamic equi- 
librium. We solve it observing that the susceptibility matrix can be written 
as function of the interaction parameters as well as function of the average 
value and the correlations of the spins. Once the interaction parameters are 
computed, the field is obtained inverting the mean-field equations. The in- 
verse problem for the mean-field approximation of the Ising model is solved 
in |Tan98[IRAHn9j and |RTHn9] . We also show how to use this method to ob- 
tain the maximum likelihood estimator of the parameters of the two models 
from a suitable sample of empirical data. 
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Chapter 1 

The Mean-Field Model 



In this chapter after defining the more general case of mean-field model we 
compute the limit for large N of the pressure function and of the distribution 
of the normalized sum of spins. As an example, we analyze the Curie- Weiss 
model. 



1.1 The model 

We consider a system composed of particles that interact with each 
other and with an external magnetic field. In particular the interaction 
between two spins is independent from their distance. Such system is defined 
by the Hamiltonian: 

J N AT 

HN{(T)^-—^(Tiaj-h^ai (1.1) 

i,j=l 1=1 



where cij is the spin of the particle i, the parameter J > is the coupling 
constant and h is the value of the magnetic field. The probability of a 
configuration of spins cr = (cti ctjv) is given by the measure of Boltzmann- 
Gibbs: 

P„,,,{.) = !r3^z£^Mnd,(.<) (1.2) 
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1. The Mean-Field Model 



where Zn{J, h) is the canonical partition function: 

N 

Jr^ ~_"t 



1=1 



and p is the distribution of a single spin in the absence of interaction with 
the other spins. In (11. 2p we do not write the inverse temperature /3 because 
we consider it inclosed in the parameters of the Hamiltonian. We assume 
that p is a non-degenerate Borel probability measure on M and satisfies 

J exp ^— — h bx^ dp{x) < oo all a, 6 G M, a > 0. (1.3) 



It is easy to check that the measure 

p(x) = ^((5(x-l) + 5(x + l)) 

where 6{x — Xq), with xq G M denotes the unit point mass with support at 
xq, verified the condition (II. 3p . The model defined by the Hamiltonian (II. ip 
and the distribution (II. 2p whit p = p is called model of Curie- Weiss. We 
explain this model in detail at the end of the chapter. 

Considered the distribution (II. 2p . it is possible to compute the expected value 
of any observable ip{(T) of interest 

N 

/ z^(cr)exp(-ifAr(cr)) TTrfp(cri) 

m^))BG = — . (1.4) 

/ exp{-HN{(T))Y\ dp{ai) 
Jr^ f=i 

The expected value {4'{(t))bg is called Gibbs state of the observable 'ipicr). 
The main observable of the mean-field model is the magnetization mj^{cr) of 
a configuration cr: 

1 ^ 

i=l 



1.2 Thermodynamic limit 
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We claim that since = the Hamiltonian (11. ip can be 

written as function of the magnetization: 

■J 



HN{(T) = -N\^-mi,{(T) + hmNi(T)j. (1.5) 

Rather then compute directly the Gibbs state (ll.4p of mj^^cr) we consider 
the pressure function associated to the model: 

The reason is that the Gibbs state of the magnetization can be obtained 
differentiating Pn{J, h) with respect to h 

N 



/ mAr(cr)exp(-i^Ar(cr)) TT(ip(cri) 



(m7v(cr)) 



BG- 



dpN _ 

dh ~ r ^ 

/ exp{-HN{cr))Y\ dp{ai) 
Jr'^ f=i 

1.2 Thermodynamic limit 

A statistical mechanical model is well posed if the Hamiltonian is an inten- 
sive quantity of the number of spins. This property is verified if the pressure 
function p]\f{J,h), associated to the model, admits limit as — )■ oo. The 
existence of the thermodynamic limit of pN{J,h) for the model defined by 
Hamiltonian (II. ip and distribution (II. 2p follows from a subadditivity prop- 
erty of the logarithm of the partition function (see |Bar08] ). 
In this section we compute the exact solution of this limit. We have to calcu- 
late the partition function Z^iJ-, h). Using the expression of the Hamiltonian 
(ll.Sp we can write the partition function in the form: 

ZN{J,h) = j exp (^N^^m'^ + hm^^dumj^{m) 
where denotes the distribution of mM{cr) on (M^, Hili P{^i))- 
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Since J > 0, by a Gaussian transform the following identity holds: 

'NJ 



exp ( —^m^ 



(^) ' I'^P [Nj[xm - \x'))dx. (1.6) 



By (11.61) we can write: 
Ziy(J, h) = ^— — ^ J J exp ^Nj(^xm — ^^^^ + Nhm^diymf^{rn)dx 



NJY f ( NJ 



ALx,{NmiJx^k)y.^^im)dx 



where 

j exp {^Nm{Jx + h)^dumj^{m) = / exp ( ^ ai{Jx + h)jY\_ dp{ai) 

N „ 

i=i 

Thus integrating over the spins we obtain 

ZN{J,h) = (^^^ ' j^exp{Nf{x))dx 

where 

/(x) = -^x^ + ln f exp{s{Jx + h))dp{s). (1.7) 

The condition (11. 3p on the measure p assures that the integral of the expres- 
sion (II. 7p is finite for each x G M. Indeed, if x < choosing a = J and b = h 
in (II. 3p we have 

exp{s{Jx+h))dp{s) < 2 fexp ( —s^+hs\dp{s)+f exp (s (J x + h)) d p{s) <oo 

\2 / J2x 



If X > choosing a = Jx and b = h in fll.3D we have 



f exp{s{Jx+h))dp{s) <2 fexp (—s'^+hs\dp{s) + f exp{s{Jx+h))dp{s) <oo 
Jr Jm V 2 / Jo 



1.2 Thermodynamic limit 
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We can state the foUowing 
Proposition 1.2.1. Let f{x) be the function defined by ( [i. 7p . Then 

1. f{x) is a real analytic function that tends to — oo as \x\ — )■ oo; 

2. f{x) admits a finite number of global maximum points; 

3. for any positive N & N 

/ ex-p{Nf{x))dx < oo (1.8) 

4- if p is a global maximum point of f{x) 

hm lln / exp(iV/(x))rfx = /(/i) (1.9) 

Proof. For complex z and L > we have 
exp(s(j2; + h))dp{s] 



< I exp{\s{Jz + h)\)dp{s) 

\s\<L 



where 



+ / exp{\Jsz\)exp{hs)dp{s) (1.10) 

J\s\>L 

/ exp{\s{Jz + h)\)dp{s) < p{[-L,L])exp{L\Jz + h\) (1.11) 

J\s\<L 



and 



f exp{\Jsz\) exp{hs)dp{s) < f exp ( — (s^ + l-^l^) ) exi){hs)dp{s) 

J\s\>L J\s\>L V2^ ^/ 

= exp(^^|z|2^^^^ exp(^^s' + hs^dp{s). (1.12) 

By inequalities (II. lip and fll.l2p and the condition f ll.3p on the measure p, 
the expression fll.lOp has order o(exp( J|zp/2)) as \z\ — )■ oo, thus the function 
/ is real analytic and tends to —oo as |a;| — )■ oo. 
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To prove the second statement we take a sequence xi of M such that 
lim f{xi) = sup f{x) = L < oo. 

Since f{x) tends to — oo as \x\ — )■ oo, the sequence xi is bounded. Thus 
we can take a subsequence Xki that tends to G M as / — ?■ oo. Hence by 
continuity of / we have 

/(xo) = lim /(xfej = sup/(x). 

This shows that / must have at least one maximum point. Since f{x) — t- — oo 
as I a; I — oo the point xq and other possible global maximum points must 
belong to a compact set. The analyticity of / ensures that inside this set the 
global maximum points are finite in number. 

We prove the statement (11. 8p by induction on A^. For = 1 we have: 

f e-^^^^cix = ff exp ( - —x'^ + s{Jx + h)]dp{s)dx 
Jr JJr2 V 2 J 

exp ^ ^ 2"''^ ~ ^^^^ 2""^^ ~'~ dp{s)dx 

1 

= (^^y j^exp(^^s^ + hsyp{s). (1.13) 

Since the integral on the left-hand side of fll.l3p is finite by the condition 
(II. 3p on the measure p (with a = J and b = h) the result (II. 8p is proved for 
N = 1. Supposed true the inductive hypothesis 



,(N-^)f(-)dx < 00 (1.14) 

and defined F = max{/(x)|x G M}, the statement follows because 

/ e^^(^)rfx < / e(^-^)^(^)rfx (1.15) 
Jr Jr 

where the right-hand side of (I1.15P is finite by the inductive hypothesis (I1.14p . 



1.2 Thermodynamic limit 
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To prove the statement (11. 9p we write 

exp {Nf{x))dx = e^f^^'^lN 



where 

In= [ exp(iV(/(x) - f{fi)))dx . 
Jr 

Since /(x) — /(/x) < 0, the integral In is a decreasing function of A^. 
Thus 

In j exp{Nf{x))dx < Nf{fx)+\nh 



hence we obtain 



lim ^In / exp{Nf{x))dx < f{fi). (1.16) 

TV— s>oo N 



By continuity of the function /, given any e > 0, there exists 6^ > such 

that as \x — fi\ < 6^ we have f{x) — f{fi) > —e. 

Thus 

In> exp(iV(/(x) - /(/i)))cix > 24e-^^ 

and in the limit 

hm 1 In / exp{Nf{x))dx > /(^) - e. (1.17) 

Since e is arbitrary the statement (II. 9p follows from the inequalities (11.16^ 
and ffLTT]) . □ 



The proposition 11.2.11 implies that in the thermodynamic limit 
jim p;v(J,/.) = Jim (i^ln (^^^ + 1 ln^exp(iV/(x))da; 



max f (x) 
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1. The Mean-Field Model 



Differentiating f{x) with respect to x and loolcing for the values that va- 
nishied the derivative we find the following condition: 



s exp ( s{Jx + h) ]dp{s) 
x = ^. ^ . (1.18) 



/ exp ^s(Jx + h)^dp{s) 



Evidently a maximum point of / must satisfy the condition (11. 181) . Let p be 
a global maximum point of /. If we differentiate the thermodynamic limit 
oi Pn with respect to h we find: 



^ da ^ dp 

p. 



sexp{s{Jp + h))dp{s) 
exp(s( J/i + h))dp{s) 



Thus p is precisely the magnetization of the system in the thermodynamic 
limit. 



1.3 Asymptotic behaviour of the sum of spins 

The study of the normalized sum of random variables and its asymp- 
totic behaviour is a central chapter in probability and statistical mechanics. 
When those variables are independent the central limit theorem ensures that 
the sum with square-root normalization converges toward a Gaussian di- 
stribution. Spins whose interaction is described by Hamiltonian (11. ip and 
distribution (II. 2p are not independent random variables, thus the central 
limit theorem can't help us to understand the behaviour of their sum 

N 

Sn{(t) = ^(Tj. 

i=l 



1.3 Asymptotic behaviour of the sum of spins 
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The generaUzation of the central limit theorem to this type of random vari- 
able was performed by Ellis, Newman and Rosen |EN78atrENR80] . 
They found that the behaviour in the thermodynamic limit of the probability 
distribution of Sn{(t) depends on the number and the type of the maxima 
points of the functional / given by fll.7p . 

Before stating and proving these results we have to clarify the meaning 
of type of a maximum point. 

Let fii, . . . , fip be the global maxima points of the function / defined in 
(ll.7p . For each p there exists a positive integer kp and a negative real number 
Xp such that around fip we can write: 



The numbers kp and Xp are called, respectively, the type and the strength of 
the maximum point fip. We define the maximal type k* of the function / as 
the largest of the kp. Define the function 



For each p = 1, . . . ,P there exists 6p > sufficiently small such that for 
\x\ < 6„N^/^'' as iV ^ oo 



fix) = fifip) + X^ 



+o{{x-fipr^). 



{2kp)\ 



B{x- y) = fix + y) - f{y). 




X 



) 



X 



X^^ + 0(l)P2fc(x) 



{2k)\ 



(1.19) 




where P2fc(a^) is a polynomial of Ik degree and P2fc+i is a polynomial of 2A; + 1 
degree. 
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Normalizing Sn{(^) by the total number of spins we obtain the magneti- 
zation. Its behaviour in the thermodynamic limit is specified by the following 

Theorem 1.3.1. Let fii, . . . ,fip be the global maximum points of maximal 
type k* of the function f{x) given by ( [i. 7| j. Let Ai, . . . , Ap be respectively the 
strengths of the maximum points. Then as N oo 

p 

J2 bp S{x- fip) 

I . 9 P=l 

Ebp 

where bp = Xp^^'^^ . 

We claim that if / admits only one global maximum point /i of maximal 
type the limiting distribution of the magnetization is a delta picked in /i. In 
other world the variance of the magnetization vanishes for large A^. When 
/ has more global maximum points of maximal type this result holds only 
locally around each maximum point. For the proof see [ENRSOj . 
Thus it is important to determinate a suitable normalization of S'iv(cr) such 
that in the thermodynamic limit it converges to a well define random variable. 
If / has a unique maximum point the problem is solved by the following 

Theorem 1.3.2. Suppose that the function f given by ( [i. 7[ ) has a unique 
maximum point /i of type k and strength A. Then 



where (—A) — J > for k = 1. 



' n(o,{-X)-^ - J-^^ ifk = l 



exp ( ^^^^^ ) tfk>l 



Instead if / has more than one maximum point we have the following 
local statement 



1.3 Asymptotic behaviour of the sum of spins 
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Theorem 1.3.3. Assume that fj, is either a nonunique global maximum point 
of the function f given by ( [i. T] ). Let k and A be respectively the type and 
the strength of fi. Then there exists A > such that for all a G {0,A) if 
miy{(T) E [fi — a, ^ + a] then 



- SN{(T)-Nfi ^ 

^kif^) = Ni-i/2k ^ < 



where (—A) ^ — J ^ > for k = 1. 



'iV(^0,(-A)-i - J-i) ifk = l 



exp 



As 



2k 



ifk>2 



The result of theorem 11.3.31 is vahd also for local maximum points of the 
function /. For the proofs of these theorems it is useful to define the function 



$p(x) = — In / ey.]){s{Jx + h))dp{s). 



(1.20) 



We claim that since 

= + \x' (1.21) 

the first statement of proposition 11.2.11 ensures that the function $p is real 
analytic. The second derivative of $p is 



Jjg exp(s( Jx + /i))(ip(s) / Jjg sexp(s(Ja; + /i))(ip(s) 



Jjg exp(s( Jx + h))dp{i 



J 



J[ s dpx{s) - [ s dpx{s 



f^exp{s{Jx + h))dp{s) 
= JVar,,(r) 



where Var^^ (Y) denotes the variance of a random variable Y whose distribu- 
tion is 

pAs) = (1.22) 



J^exp{s{Jx + h))dp{s) 



Since p is a nondegenerate measure, by definition of variance of a random 
variable, $p(x) > for any x G M. 
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The proofs of the theorems 11.3.11 and 11.3.21 also need the following pre- 
liminary results: 

Lemma 1.3.4. Suppose that for each N, Xn andY^ are independent random 
variables such that Xn — )■ jy, where for all a 

Then Yn jj if and only if Xn + Yn-^v*^. 

Where u * fi indicates the convolution of two distribution, that is: 

POO 

u * fi = / ^{x — t)^{t)dt. 



Proof. Weak convergence of measures is equivalent to pointwise convergence 
of characteristic functions. □ 

Lemma 1.3.5. Suppose that the random variable W ~ A^(0; J^^) is inde- 
pendent of Sn^ct) for all N > 1. Then given 7 and m real, the distribution 
of 

W ^ Sn{(t) - Nm 



is given by 

exp (^Nf(^^ + n?j^ds 



exp [Nf[^ + ^))ds 



(1.23) 



where the function f is given by ([i.Tp . 
Proof. Given 6 real 

where E = {-00, ON^-^' + Nm]. The distribution of VNW + Sn{(t) is 
given by the convolution of the Gaussian A^(0, NJ^'^) with the distribution 
of Sn{(t) 

exp I I —-rfs"^ + hs ] ] dvs{s) 



1.3 Asymptotic behaviour of the sum of spins 
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where dvs{s) denotes the distribution of SNicr) on (IR^, Hili P(^i))- 
Thus we have: 



J \^ 



h) \2nN 



X / exp 
'e 



_J_ 

2N 



t^^ j exp (^(^t + h^dus{s)dt 



exp ( Nf[ -j^+m ) ]dx. 



where 

j exp (^t + ^ dus{s) = n y exp (^i (^t + h]] dp{(ri 

If we make the following change of variable 

_ t - Nm 

Ari-7 

and we integrate over the spins, we obtain: 

(1.24) 

Taking — )■ oo the f ll.24p gives an equation for Zn{J, h) which when substi- 
tuted back yields the distribution (11.231) . The integral in (11.231) is finite by 

(USD. □ 

We remark that for 7 < 1/2 the random variable W does not contribute 
to the limit of the distribution (I1.23P as — )■ 00. 

Lemma 1.3.6. Defined F = max{/(x)|a; G M}, let V be any closed (possibly 
unbounded) subset ofR which contains no global maxima of f{x). Then there 
exists e > so that 

^-NF f ^Nfix)^^ ^ 0{e-^') N^oo. (1.25) 

Jv 

Proof. V contains no global maxima of f{x), thus: 

sup f{x) < sup f{x) — e = F — e 
xev xeR 
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hence 



Jv Jv 



IX 



e 



1 



The condition (11. 3p on the measure p (with a = J and b = h) assures that the 
latter passage of (fT^ is 0(e~^') as ^ oo. This proved the ffT^ . □ 

At last we can prove the theorems 11.3.11 and ll.3.2[ 
Proof of Theorem \1. 3. 1[ By definition m7v(cr) = S]\f{(T)/N, thus by lemmas 
11.3.41 and 11.3.51 (with 7 = and m = 0) we know that 

W ^ Sn{(t) e^f^'^Ux 



Vn n 



where W ~ A^(0, J ^). We have to prove that for any bounded continuous 
function 0(x) 

, ?zL_ . (1.27) 

/ e'^'^^^dx ^ b, 

Jr p=i 

Consider 61, . . . ,6p such that the conditions expressed in (I1.19P are satisfied 
we choose 6 = min{5p | p = 1, . . . ,P}, decreasing it (if necessary) to assure 
that < 6 < min{|/ip — Pq\ : I < p q < P}. Denoted by V the closet set 

p 

V = R-[j{fip-S,pp + 6) 

p=i 

by lemma 11.3.61 there exists e > such that as iV — )• 00 

g-7VF f ^Nf{.)^^^^^^ ^ 0(e-^^). (1.28) 
Jv 



1.3 Asymptotic behaviour of the sum of spins 
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For each p = 1, . . . , P we have 



where the two equahties foUow from suitable changes of variable. First we 
define u = x — fj.p, and then w = uN^/'^^* . Thus by (11. 19^ and the dominated 
convergence theorem 

lim ivV2fc*e-^F / e^-^(^V(x)rfx = 



N^oo 



Since Ap < the integral of (11.291) is finite. Making the change of variable 



w 

X 



(-A,)V2/=* 

in the right-hand side of fll.29p we obtain: 

lim iVi/2/c*g-JVF / e''f^^^ct){x)dx = 



Af-s>oo 



Alp 



-5 



0(/^p)(-Ap)^/^^*^exp(^-^)da:. (1.30) 

By (USED and 

n / 2k* \ 



N-^oo 



p=l 
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In a similar way for the denominator we have 



hm iVi/2'^*e-^^ [ e^^(^)rfx = y (-AJi/^fc*/ exp(-^^)dx. (1.32) 
Jr ^ Jr \ {2k*y.J 



Now the statement (n^27\i follows from ffOT]) and ([L32]). □ 

Proof of Theorem \1.3.2[ By lemma 11.3.51 and 11.3.61 (with 7 = l/2k and 
m = fi) we know: 



_/Yl/2-l/2fc ' ]\Jl-l/2k r (fx 



where W ~ A^(0, J ^). If A; > 1 to prove the result it suffices to verify that 
X W , , ^ , /" ( \ 



exp ( Nf ( ^^)) '^(^^^^ y (2^^^ y 0(x)c/x 



(^^ ( iVW + ) / ( (2^ J 

for any bounded continuous function : M — M. We pick 5 > such that it 
satisfies the conditions f ll.lQp . By lemma fl.3.61 there exists e > so that as 
N ^ 00 



«^P ( ( ^ + ^')) ^(^)d^ = OiN^'^'e-""^) (1.34) 



where F = max{/(x)|x G M}. On the other hand as |x| < 



l<<5ArV2fc 



e^^^-^^'^)) / exp(iV5(^;/i) )0(x)dx. 
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By (ll.lOp and the dominated convergence theorem 



exp ( -^x'^'' ](l){x)dx (1.35) 



X2k)\ 

where the integral of the right-hand side of (II .351) is finite because A < 0. By 
(041) and (OHj) the statement (1L33|) follows for A; > 1. 

For A; = 1 in analogous way we prove that for any bounded continuous 
function : M M: 

exp (^Nf(^--^ + fi^^(f){x)dx J exp (^^x'^^(f){x)dx 



The Gaussian A^(0, (— A)~^) obtained is the convolution of the limiting di- 
stribution of the random variables W and 5*1(0-). Since W ~ N{0,J~^), 
the random variable 5i(cr) as — ?■ 00 has to converge to a Gaussian whose 
CO variance is (— A)~^ — J^^. To complete the proof we must check that 

(-A)-^ - J-^ = ^ > (1.36) 

where we claim that A = /"(/u). Considering the function $p defined in 
(nrm . by (ir:^ we have A + J = J$"(/u). Since ^'^(fi) > and A < the 
inequality ( I1.36P holds. □ 

To prove Theorem 11.3.31 it is useful to consider the Legendre transforma- 
tion of the function $p defined in (ll.20p 

$:(?/) = sup{xy-<l>^(a;)}. (1.37) 



We claim that it is possible to define the function $* because $p(x) > for 
all X eR. 
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We can state the following 



Lemma 1.3.7. Let $* the function defined in ( 1.31 ) and n a maximum point 
of the function f given by ([i. Then 

1. There exists an open (possibly unbounded) interval I containing fi such 
that $* is finite, real analytic and convex (with ($*)"(a;) > 0) on I and 



$* = +00 on I 



c 



2. Consider the random variable Un{c) = fn]\f{cr) — fi. Denote by vu 
its distribution on (IR^, Hili PmI'^j)) where is given by M.22\l with 
X = fi. For any u > 

p{Uj,icT) > u} <exp(^-NJi^;ip+u)-<^;ip)-{<^;yifi)u)y (i.ss) 

3. There exists a number uq > such that for all u G (0, Uq) 

+ u)- = u + i{u) i{u) > (1.39) 



Proof. Since ^p{x) > for all a; G M the function is strictly increasing 
and hence admits inverse By (11.371) the function $* is bounded if 

and only if there exists a point Xq G M such that y = $^(xo). This condition 
is verified when y belongs to the image of the function In this case we 
have 

$;(!/)= - $p(xo) inny) = iKy\y) (ny'(y) = ^ijj^^ (i-^o) 

Thus $* is real analytic and convex in particular with ($*)"(y) > 0. By 
(ll.2ip and (ll.lSp we have $p(/i) = fi, hence /i is inside the image of On 
the other hand for y in the complement of the closure of the image of $^ 
we have ^*p{y) = +oo. This shows that the first sentence of lemma 11.3.71 is 
proved taken / equal to the image of 



1.3 Asymptotic behaviour of the sum of spins 



19 



Let V be any measure on SS. Choose + /i > 0, by the exponential 
Chebyshev's inequahty we can write: 

^P{e.p(f.,,....,)>exp(..„....))} 



< E 



Xi{Jy + h) 



exp{—Nw{Jy + h)) 



N 



= exp{—Nw{Jy + h)) TT / exp(a;i(J?/ + h))di'{xi) 

i=i 

< exp ( — Nhw — Njiwy — - / exp{xi{Jy + h))di'{x, 

^ ^ J Jr 

< exp ^ - Nhw - iVJsup - ^„{y)\{Jy + /i) > o| 



where is given by fll.20p with p = v and E[-] denotes the expectation value 
with respect to the measure p. By convexity of the function whenever 
w > J^xdu^x) the superior value of {wy — ^u{y) \ y ^ ^} is reached for 
Jy + h > 0. This shows that: 

P<^ "^^Xi > Nwj < exp ^ — Nhw — A^J$*(w)j whenever w > y xdi'{x). 

Since // is a maximum point of the function / by the condition f ll.lSp and 
the definition of the measure (11.221) with x = p 

, I ^ f^xexp{x{Jp + h))dp{x) 
xdp^{x) = -p — — — — - — — — - = p < p + u. 



J^exp{x{Jp + h))dp^{x] 



Thus 



P{Un{(t) >u} = P{Sn{(t) > N(p + u)} 

< exp{-Nh{p + u)- NJ^*p^{p + u)) 
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where 



= sup + u)y - -J Inyexp ^s^J^y + /i + j j + h^^dp{s) 
+ — : In j exp{s{Jp + h))dp{s)\ 



+ SUp|(^ + M)(^y + /i + ~ *^'»(^ + ^+ 7)} 



+ U) - p^ - pU- ^{p + U) + $p(yU). 



Since (<l>P"^(/i) = by f!1.40p we have 

«l>;(/i) = /i^ - (<l>;)'(^) = /i. 

Thus 



P{Un{o-) >u}<exp(^- Nh{p + u) - NJ{^*p{p + u) - 

h 
1 

exp(-iVJ($:(/x + u)~ %{p) - {%)\p)u)). (1.41) 



This proves the statement fll.38p . 



Since is a maximum point of / there exists mq > such that x > ^'p{x) 
as X G (/i, yU + Mq). Thus,($*)'(/i + -u) > p + u is true for any u G (0,Mo). 
Since ($*)'(//) = fj, the sentence (I1.39P is proved. □ 
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Lemma 1.3.8 (Transfer Principle). Let vu he the distribution of the random 
variable t/iv(cr) = m]\f{(T) — ji on (R^, fl^^ (ip^((Tj)). There exists B > 
only depending on p such that for each B G (0, B) and for each a G (0, B/2) 
and each r G M, there exists 6 = 6{a, B) > such that as N ^ oo: 

exp ( irN^w —w^] [ exp{N Juw)dh'u {u)dw 



2 

exp ( irN^w —w'^ ] I exp{NJuw)dh'u{u)dw + 0{e~^^). 



\w\<B 



?i|<a 

2 



Proof. We shall find -B > such that for each B G (0,5) and each a G 
(0, B/2), there exists 6 = 6{a, B) > such that as — t- oo 

[ exp ( - ^w^] [ exp{NJuw)duu{u)dw = 0(6"^^") (1.42) 

J\w\>B 

and 



w\>B V 2 / J\u\<a 



[ exp(-^wA[ exp{NJuw)dvu{u)dw = 0{e~^~^). (1.43) 

J\w\<B V 2 / J\u\>a 



We start with equality f ll.42p . For any i? > and any a G (0, 5/2) we have 

NJ 
1 

\w\>B \ 2 / J\u\<a 

<2 I exp (-Nj(— — aw dw 



exp ( '^'^^^ [ J'uw)dvu{u)dw 



B 



< 



2 J expi-NJw(^—-ajjdw. (1.44) 



As cx) the latter integral in is 0{e-^^') whit 6i = B{B/2 - a), 

thus the equality fll.42p is proved. 

In the proof of identity f ll.43p we exploit the following result 

E[Yl{a<Y<b}] < aP{Y >a) j P{Y > t)dt (1.45) 

J a 

where F is a random variable whose distribution is given by py, 5[-] denotes 
the expectation value with respect to the distribution py and l{a<y<6} is the 
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indicator function of the set {a <Y <b}. The inequality fll.45p is obtained 
integrating by parts the left-hand side of the following: 

I P{Y > t)dt = bP{Y > 6) - aP{Y > a) - tP{Y > tydt 

J a J a 

and observing that P{Y > t)' = —pyit). 

The left-hand side of equality fll.43p is upper bounded by 

25 sup [ exp ( - Nj(— -uw)]duu{u)- (1-46) 

\w\<B J\u\>a \ ^2 // 

The integral in fll.46p breaks up into one over (a, +oo) and another over 
(— cxD,a). For the first using fll.45p . we obtain 



sup / exp I — NJ{ — uw ) ) dvuiu) 

w\<BJa \ ^2 // 

< sup exp ( — Njf— waj \ P{Un{(t) > a} 

\w\<B V ^2 // 

+ JNB snp [ exp ( - Nj(^ - uw)\p{UNi(T) > u}du. 

\w\<Bja \ ^2 // 



1.47) 



By fll.38p we can bound P{UN{a) > u}, where u > a. In particular for 
M > a it holds 

{u^ + 9i for a < u < un 
- - (1.48) 
U62 for u> Uq 

where Oi = £ ^{t)dt > and 62 = ^{uq/2)/2. 

We consider an interval I such that lemma IT. 3. 71 is verified. For all p + u G I'^ 
the fll.48p holds since + u) = +00. For /i -|- u G /, if a < m < % by 
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ffTaOD we have: 



u 

*\// 



t + i{t)dt 



- 2 ^ 



This prove the first line of fll.48p . \i u > Uq, ioi uq/ 2 < t < u 

(<^>;)'(/i + t)- (<i.;)'(/x) > ($;)'(/. + ^)- > 

thus if w > Wo 

nu nU 

/ TOV + t)-TO'(/^M^> / TOV + t)-TOW^ 



'«o/2 



This proves the second line of fll.48p . 

Choose B such that < B < 62, for any B E (0,5) using fll.38p and 
(fOSj) we have 



\w\<Bja 



NBJ sup / exp - JA^ — - P{f/Ar(cr) > u}du 



2 



< NBJ sup / exp ( - iV ( -w-^ - Juw + — + Oi ] ]du 

\w\<Bja 



hoc / / T 

.2 



|-!il|<_B ■/ UO 

Since 



+ NBJ sup / exp - -w^ - Juw + m6'2 ]du. 



2 



and 
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we obtain 

NBJ snp J exp Jn(^^ - uw^^P{UNi(T) > u}du 

Thus the last line of fOTj) is 0{e-^^^) where 62 = min{^i/2, mo(^2 - B))}. 
Concerning the term of (11.471) involving P{Un{(t) > a} we have 

sup exp ( — Nj(^ wo) ) P{Un{(t) > a} 

\w\<B V ^2 // 

< sup exp ( - Nj(^ -yja + ^ + Oi)] = 0(e-^^^). 
\w\<B V ^2 2 / J 

The integral over (—00, a) is handled in the same way. Thus we have proved 
identity flL42|l and fOHjl with 6 = min{5i, 62}- □ 

Now we can prove the theorem ll.3.3[ 
Proof of Theorem \1. 3. 3[ Given k > 1, to prove the statement we must find 
A > such that for each r G M and any a G (0, A) when the magnetization 
m]\f{(T) is inside [fi — a, fi + a], the Gibbs value of the characteristic function 
of the random variable Sk{cr): 

r - ^ 

\mN{cT)-iJ,\ <a) = (1.49) 

/ BG p 

\mM(cr)-^J.\<a 



tends as —7- 00 to 



|^exp(.r.)exp(^.^^)ci. 



1.50) 



Defining 

-niv(cr) = 



2 V ^/N 
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we can write fll.49p as 



I /X I ^ \ V|mjv(<T)-/i[<a ,-^-| 

\m]^[(T) — /i| < a) 



where is the measure defined by fll.22p with x = p. 
Consider the random variable 

Un[(t) = 



and let pu be its distribution on (M , ni=i dp^j,{ai)). We can write 

'NJ 

I exp[irl\ 'u) exp ( 



Ibg f {NJ 

J \u\<a 



exp (^—u^^dvu{u) 



By identity fll.6p with m = u after the simplification of the term ^JNJ/2t{ 
the right-hand side of fll.Sip becomes 

exp(irA^'''M) ( exp ( + N Jux\dvu{u)dx 

7 Ju ■ ^ ^ 

exp ( TT^'^ + NJuxjdh'u{u)dx 

{|u|<a}xR V 2 / 



Making the change of variable 



w = X + —— — (1.53) 

the fll.52p becomes 

exp I — TATi-2 I [ ^-^P (irN^w —w^^ f exp{NJuw)dh'u{u)dw 

\2JN J Jr ^ 2 ^ J\u\<a 

[ exp( — N—w^^ f exp{NJuw)di'u{u)dw 

R ^ 2 ^ J\u\<a 

(1.54) 
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The change of variable fll.53p is justified by the analyticity of the integrand 
in fll.54p as function of w complex and the rapid decrease of this integrand 
to zero as \Re{w)\ — )■ oo and \Im{w)\ < IrlA^"^. Since /c > 1 we have that 



2 



exp ) ^ 1 as — )• 00 



hence we can neglect this term for the rest of the proof. Using the transfer 
principle 11.3.81 we can find i? > such that the (11.541) can be written as 



exp (irN^w —w'^\ I exp{NJuw)dh'i/{u)dw 

V 2 / /id 



'"l-^ +0(e-^^"). (1.55) 



/ exp ( 




/ exp{NJuw)diyu{u)dw 


J\w\<B ^ 







Making the change of variable s = N^w and pick B = min{5, B}, where 6 is 
taken such that the conditions (I1.19P are verified, we have for (I1.55P 



exp(irs) exp ^ — JN^ ^'^"2') J ^'^^^ 



(JN^ ^us)dvu{u)ds 



s\<BN2 \ ^ / JR ^ 0(e"^^) 

/ exp ( - JA^i^^tI. ] f exp{JN^-^us)diyuiu)dt 
J\s\<Bm \ ^ J Jr 



where: 



exp(JA^ ''us)dvij{u) 

y^exp (^-^s{Sn{(t) - Nfi)^ exp{SNicr)iJfi + h))f[dp{(Ti 



N 



exp(S'Ar(cr)(J/i + /i)) ]^(ip((Ti 

i=l 

exp (iVj($(/. + ^) -$(/.)- p^)) 



1.4 Example: the Curie- Weiss model 



27 



Thus 

exp ^ - JN^-^^^^ J exp{JN^-^us)diyuiu) 

= exp(iv(/(^+^)-/(;.))) 

= exp(iV5(^;^)). 

By conditions expressed in (11.191) and the dominated convergence theorem 
the statement follows. □ 



1.4 Example: the Curie- Weiss model 

Now we describe the Curie- Weiss model, that is a model defined by Hamil- 
tonian (II. ip and distribution fll.2p where p is given by 

p(x) = i(5(x-l) + 5(a; + l)). 

For further arguments related to this model see [EllOSj . The definition of p 
implies that the space of all configuration is Qn = {l^""!}^- The function 
/ given by (11. 7p becomes 

/(x) = — — a;^ + lncosh(Jx + /i) (1.56) 

whose estremality condition is given by the so called mean-field equation 

/i = tanh( J/i + /i). (1-57) 

The solutions of this equation are the intersections between the hyperbolic 
tangent y = tanh(J/i + h) and the line y = p. As h ^ 0, for any positive 
value of J the equation (11.571) admits a unique solution ph different from zero 
that has the same sign as the field h. This solution is the unique maximum 



28 



1. The Mean-Field Model 



point of the function /. On the other hand as h = the number of solutions 
of equation f ll.57p depends on the slope J of the hyperbolic tangent. If J < 1 
there is a unique solution, the zero, which is the unique maximum point of 
the function /. If J > 1, the equation fll.57p admits other two solutions i/ig. 
In this case the function / reaches its maximum in ±/io- To determinate the 
type and the strength of the maximum points of / as parameters J and h 
change, we compute the even derivatives of / in the points until we obtain a 
value different from zero. We obtain 

1. if /i 7^ and J > the maximum point fit is of type k = 1 and strength 

A = -J(l- J(l-^2). 

2. if /i = and J < 1 the maximum point is of type k = 1 and strength 
A = -J(l - J); 

3. if h = and J > 1 maximum points ±/io are of type k = 1 and strength 
A = -J(l- J(l-/ig); 

4. if /i = and J = 1 the maximum point is of type k = 2 and strength 
A = -2. 

By theorem 11.3.11 we get the distribution in the thermodynamic limit of the 
magnetization: 



m]\f{(T) — > < 



5{x-Hh) h^O,J>0 
5{x) h = 0,J <1 

^6{x — Ho) + ^6{x + Ho) h = 0, J > 1. 

Defined the susceptibility of the model as x = dfi/dh, by the main field 
equation f ll.57p we obtain 



(1 - /i^) 

1 - J(l 
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By theorem 11.3.21 it is easy to check that in the thermodynamic limit 



^^^'^^"^''-4iV(0,x) asJ>OandMO 



SNi(T) ^ ^^Q^ as < J < 1 and /i = 



4 

X 



dx 



, ^ as J = 1 and /i = 0. 



If J > 1 and h = the function / admits two global maximum points ±/io- 
Considering the point fiQ, by theorem 11.3.31 there exists A > such that for 
all a G (0, A) if mN{cr) E [/xq — a, /io + 



An analogous result holds for the point —fiQ. 

To complete the description of the Curie- Weiss model we analyze its phase 
transition. A phase transition point is any point of non-analyticity of the 
thermodynamic limit of the pressure occurring for real h and/or real positive 
J. If /i 7^ it is easy to show that there is not any phase transition. The 
situation is totally different as /i = 0. In absence of the field h we have: 



lim Pn{J,0) 



when J < 1 



' -|yUo + lncosh(J/io) when J > 1. 

As J — 7- 1^ the spontaneous magnetization fio tends to zero, thus the limit 
of the pressure is continuous for every values of J. Differentiating this limit 
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with respect to J we obtain: 



1 .2 



2 

Thus in zero magnetic field 



d ( , , „.\ I when J < 1 



dJ^^^-- ^ 11^2 ^henJ>l. 

Also this function is continuous in J . If we differentiate another time the 
limit of the pressure we get: 

d"^ ( \ djj, 



aj2 



(jimMJ,/.))=/.^. 



Since 

in zero field we have: 



-— hm Pn{J,0) 



when J < 1 



^ when J > 1. 



(1.59) 



V2 dJ 

Just below J = 1 the value of /io is small, thus we can expand the hyperbolic 
tangent of the mean field equation fll.57p : 

/xo = J/io - -^^^^ + asJ^l+. (1.60) 

3 

Since /iq is different from zero as J > 1, we can divide by J/iq the equation 
ffm)]) . We obtain 

j = l-^ + 0(A.^) as J^l\ 
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Thus: 

and the second line of (11.591) can be approximate in the following way: 

2dJ 2dJ\\ JJ) 2P J ^ ' 

By fll.6ip it follows that the second derivative of the thermodynamic limit 
(11.591) is discontinuous. The model exhibits a phase transition of the second 
order for h = and J = 1. We claim that for this choice of the parameters 
the normalize sum of spins does not converge to a Gaussian distribution in 
the thermodynamic limit. Thus the theorems II. 3. II and II. 3. 21 are potent tools 
to obtain information about the criticality of a phase. 



Chapter 2 



The Multi-Species Mean-Field 
Model 

In this chapter we deal with the multi-species generalization of the Curie- 
Weiss model. After computing the exact solution of the thermodynamic limit 
of the pressure we analyze the asymptotic behaviour of the normalize random 

vector whose components are the sums of the spins of each species. 

2.1 The model 

We consider a system of N particles that can be divided into n subsets 
Pi, . . . , P„ with PiDPs = 0, for / ^ s and sizes |P;| = Ni, where Y.7=i = ^■ 
Particles interact with each other and with an extern field according to the 
mean field Hamiltonian: 

^ TV N 

Hn{<t) = -— J2 -^ii^i^j - hiGi . (2.1) 

i,j=l i=l 

The cji represents the spin of the particle i, while Jij is the parameter that 
tunes the mutual interaction between the particle i and the particle j and 
takes values according to the following symmetric matrix: 
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Ni 



N2 



Nn 



\ 



Jll 


Jl2 




Jin 


Jl2 


J22 














Jin 


J2?i 







J 



where each block J^^ has constant elements Jig. For I — s, Ju is a square 
matrix, whereas the matrix 3 is is rectangular. We assume Ju, J22, • • • , Jnn 
to be positive, whereas J/s with / 7^ s can be either positive or negative 
allowing both ferromagnetic and antiferromagnctic interactions. The vector 
field takes also different values depending on the subset the particles belong 
to as specified by: 



hn 

V / 



where each is a vector of costant elements hi. 

The joint distribution of a spin configuration cr = (ui, . . . , a^) is given 
by the Boltzmann-Gibbs measure: 



^iv,j,h{o-} 



exp{-HN{(T)) 



N 



n ^p(^i) 

i=l 



(2.2) 



2.1 The model 
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where Zm{J, h) is the partition function 

ZN{J,h)= / exp{~HN{cr))Y\ dp{ai 
and p is the measure: 

1 



N 



i=l 



(2.3) 



p{x) = -{6{x-l)+6{x+l) 



(2.4) 



where S{x — Xq) with xq G M denotes the unit point mass with support at 
Xq. The definition of p implies that each spin can take only the values ±1. 
The inverse temperature (3 isn't explicitly written because it is included in 
the parameters of the Hamiltonian. 

By introducing the magnetization of a set of spins A as: 



' ' ieA 



and indicating by mi{(T) the magnetization of the set Pi, and hj ai = Ni/N 
the relative size of the set Pi, we may easily express the Hamiltonian (12. ip 
as: 

Hn{(t) = -Ng[mi{(T), . . .,mn{cr)^ 
where the function g is: 



(2.5) 



^ n n 

g{xi, . . . , x„) = - ^ aiUsJisXiXs + ^ aihixi. 



(2.6) 



Ls=l 



1=1 



Defined 



Jll Jl2 
Jl2 J22 



Jin 
J2n 



Jin J2n • ■ ■ Jnn j 



we can write the function (7 in a compact way as 



h2 



\hn J 



(2.7) 



(2. 
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where the matrix J = DaDaJDaDa, the vector h = D^Dcth and the 
matrix Dq, = diag {^/oi, . . . , ^/a^}. The matrix J is called reduce interaction 
matrix. 



2.2 Thermodynamic limit 

The existence of the thermodynamic limit of the pressure 

P7v(J,h) = ^lnZAr(J,h) 

associated to the model defined by Hamiltonian (12. ip and distribution (12. 2p 
is proved in the paper [GC08j . In this section we compute the exact solution 
of this limit exploiting a tails estimation on the number of configurations 
that share the same vector of the magnetizations. In this way we obtain 
a lower and an upper bound for the partition function that converge to a 
same value as — oo. This technique is used by Talagrand to compute the 
thermodynamic limit for the Curie- Weiss model |Tal03] . 

Since the spins variable can take only two values we can write the partition 
function as 

Z^(J,h) = ^ exp(-if^(cr)) 

where Qn = { — 1, 1}^ is the space of all possible configuration cr. 

Denote with cri the configuration of the spins of the set Pi and define 



A^^ = card <^ cr, G Qn, 



miia) = fxi \ (2.9) 



using the Hamiltonian expressed as function of the magnetizations (12. 5p 
where the function g is given by (12.80 we can write: 

Z^{3, h) = 5^ n exp m) + (h, ^^)) 

11 1=1 ^ ' 

where the sum extends over all the possible values of the random vector 
(mi(cr), . . . ,m„(cr)). 
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Lemma 2.2.1. Consider the set = { — 1,1}^' of all possible configura- 
tion (Ti. Let be a positive number defined by ^2.9\) . Then the following 
inequality holds 

1 2^' 

--^eM-Ni.y{lii)) < A^, < 2^'exp(-iV;^(/xO) (2-10) 
where C is a constant and 

y(x) = ^ ((1 + x) ln(l + x) + {l-x) ln(l - x)) (2.11) 



Proof. As mi{cr) = fii, the configuration cri contains Ni{l + /i;)/2 times the 
value 1 and A^z(l — /xz)/2 times the value —1, thus we have: 

A = ( 



Using Stirling's formula, n! ~ n"e "'A/27rn, we get 



Ni 



1 2^' 

> 



1 2^' 



cjn, 



exp{-Niy{fii)) (2.12) 



The f l2.12p gives a lower bound of A^,. To obtain an upper bound for 
we suppose the spins (jj independent. In this case all configurations ct; have 
same probability, hence 

A^, = 2^'p|mi(<T) = /izj < 2^'p|mi(o-) > /i; 
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2. The Multi-Species Mean-Field Model 



where by definition of the magnetization 

p\mi{(T) > III] = p\si{ct) > fiiNi I (2.13) 



Take A > by Chebyshev's inequality we can bound the probability f l2.13|) 



p\si{ct) > fiiNiX < e-^^'^' nEp[exp(Aa,)] 

i=i 



= exp{Ni{—\fii + In cosh A)) 

< min{exp(iVz(-A/ii + lncoshA))} (2.14) 

A 

where Ep[-] denotes the expectation value with respect to the measure p given 
by (12. 4p . If \fii\ < 1, the exponent in the last line of (I2.14p is minimized for 

A = tanh-^(/iO = ^ In (l^) (2.15) 
2 \\.- IliJ 

Since 1 / (cosh^ y) = 1 — tanh^ y the following equality holds 

IncoshA = -^ln(l -/if) (2.16) 
Thus by (127[5D and fl2A6D 

min{exp(iV;(— A/i; + In cosh A))} = exp{—NiJ^{fii)). 

A 

Hence we obtain the following upper bound for 

<2^'exp(-iV,^(/iO). (2.17) 
The statement f ETTU]) follows by fl^TT^ and flZTTjl . □ 

The lemma 12.2.11 allows to bound the partition function in the following 

way: 

^ n ^ n 

-l[-=exp (iVmax/(M)) < ^^(J, h) < n(^^ + 1) ^xp (iVmax/(M)) 
1=1 ^ 1=1 
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where 

^ n n n 

/(xi, . . . , x„) = - ^ aiasJisXiXs + ^ a^/iiXz - ^ J^(xO. (2.18) 

/,s=l i=l 1=1 

and the function is defined in (12.111) . Hence for the pressure we have: 

- ^ ( In C + ^ In iV,") + max /(/x) < p^{J, h) 
^ 1=1 ^ 

^ ^ ( E + 1)) + ^^^^ /(^)- 

Thus the limit as — t- oo of the pressure is obtained by maximazing the 
function / defined by (I2.18p . Differentiating / with respect to xi, . . . , we 
obtain the mean field equations of the model: 

Xi = tanh ( ^ aiJii xi + hi 
^1=1 

X2 = tanh I Yli otiJ^i xi + h2 

^1=1 ^ (2.19) 

Xn = tanh ( ctiJin Xi + hn) . 
{ ^1=1 ^ 

When the reduce interaction matrix J is positive define we can compute 
the thermodynamic limit also using the Thompson method |Tho88] . Consid- 
ering the Hamiltonian written as function of the magnetizations (12.51) where 
the function g is given by (12.81) . the partition function (12.31) can be expressed 
in the form: 

Zn{3M = 



exp ( ^ ( 2 (J™' ™-) + ™) ) ) ^'^M (m) 



where Um denotes the distribution of the random vector (mi(cr), . . . , m„(cr)) 

on (M^^tlP(^.))• 

Since J is a positive define matrix the following identity holds 



exp ( — (Jm, m) 



A^det J 
(27r)" 



exp 



y ( Jx, x) + iV( Jx, m) ) (ix. 



(2.20) 
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Using ( I2.20p the partition function becomes 

X jj exp ^n(^ - ^(Jx, x) + (ii, m) + (Jx, m)^^ (iz/M(m)cix 



^7v(J,h) 



A^det J\ 2 



(27r)" 

xf exp (n(—1-{J:s.,x.)']^I exp [iv('(Jx + J, m)')')c?i/M(m)c?x. 

Since 

J exp |^Ar(^(Jx + J,m))^rfz/A/(m) 

= / exp ( ^ ^ cTj ^ a3</zsa;3 + J JJ c^p(o-i) 

= JJJJ / exp ( aiaj ( asJisXs + /^;) ) c?p(o^») 



summing over the spins we obtain 

'Vd 



Z^(J,h)=(— — / exp(iV/(x))cix 



where 

f{x\, . . . , Xji^ 



- ^ aiOsJisXiXs +^ a/ In ( cosh f ^ asJisXs + h 

Ls=l 1=1 ^ ^ s=l 



(2.21) 

We can state the following: 

Proposition 2.2.2. Let f be the function defined in \2.21\) associated to a 
model defined by the Hamiltonian Ii2.5\) . If the reduced interaction matrix J 
is positive define, then 

1. f has a finite number (different from zero) of global maximum points. 
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2. for any positive N e 



exp(A^/(x))(ix < oo 



(2.22) 



3. if fj, is a global maximum point of f 

lim i-ln /" exp(iV/(x))rfx = /(M). 



(2.23) 



Proof. Since coshy < e'^' for all ?/ G M the following inequality holds: 

^ n n n 

fixi,...,Xn)<--'^aiasJisXiXs + '^ai'^asJisXs + hi . (2.24) 



«,s=l 



1=1 



The function on the right-hand side of fl2.24p goes to — oo as |x| — t- oo. Thus 
by (12.241) the function / have to show the same limiting behaviour. This 
property together with the analyticity assures that the function / admits a 
finite number (different from zero) of global maxima points. 

We prove the second statement by induction. As iV = 1, since a; < 1 for 
each / = 1, . . . , n, we have: 



< 



/ exp - ^ aiUsJisXix^ ]^cosh {j^asJ^Xs + hi^dxi . 

Ls=l 1=1 s=l 



< exp ( n maxj/ii} + max < -(J ^bo-,bo-) 

\ i bo- 1 2 



1 



where bg. = {(yiYl^=i'^i'Jiij---^(^nJ2^=i'^i'Jin)- This proves the statement 
for = 1. Defined F = max{/(x)|x G M"} and supposed true the inductive 
hypothesis: 

' e(^-i)^Wdx < oo 
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we have: 



This proves the statement fl2.22p . 

As in the one-species case, to prove the statement fl2.22p we write 

[ exp(Ar/(x))rfx = e^^^'^^/jv 

where 

1^= [ exp(iV(/(x) - /(Ai)))dx. 

Since /(x) — /(y^) < 0, the integral In is a decreasing function of A^. 
Thus 

In / exp(A^/(x))rfx < iV/(/x) + In/i. 

Hence we obtain 

hmi-ln/ exp(Ar/(x))rfx < /(//). (2.25) 

By continuity of /, given any e > 0, there exists 6^ > such that as x is 
inside the ball -B(/x, S^) we have /(x) — /(/x) > — e. We can write: 



In > / exp(Ar(/(x) - f{fi)))d^ > T.j^^J^e-''^ 



where Tix] is the function Gamma of Euler. Thus 



lim In / exp(Ar/(x))t;x > /(^) - e. (2.26) 



Since e is arbitrary the statement (12.231) follows from the inequalities (I2.25p 



and dOni). □ 
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The proposition 12.2.21 infers that in the thermodynamic limit 

lim Piv(J,h) = lim ( ^In ( ^ ) + ^ In /" exp(A^/(x))rfx 
= max / (x) . 

X 

The extremal conditions of / give again the same mean-field equations fl2.19p . 



2.3 Asymptotic behaviour of the sums of spins 

In this section we generalize the results obtained by Ellis, Newman an 
Rosen in [EN78aj and [ENRSOj . In particular denoted by 

the sum of the spins belong to the set Pi we determinate the suitable nor- 
malization of the random vector (5*1 (cr), . . . , ^^(cr)) such that in the thermo- 
dynamic limit it converges to a well define n-dimensional random variable. 

Before to go on we introduce some notations. Considering x, y G M" and 
7 G M we define 

• xT = {xl,...,xl)- 

• Xy = (Xiyi, . . ..XnVn)] 




where j// 7^ for / = 1, . . . , n. 



We shall see that the behaviour of the limiting distribution of the random 
vector of sums of spins depends crucially on the number and the type of the 
maximum points of the function / exploited in the Thompson method to 
compute the thermodynamic limit. We recall it: 

/(xi, . . . , x„) = ^ aiOsJisXiXs +^ailn f cosh ( ^ J/^x^ + hi]j. 

l,s=l 1=1 ^ ^ s=l ^ ' 

(2.27) 
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Let be global maxima points of the function / defined in 

(I2.27p . For each p there exist the functions f2j{'^) < 0, such that around /Lt^ 
we can write / as: 

/(x) = fi^n + E - M^) + o((|x' - M^'r + |x" - M^'?/^)') (2.28) 

where (x', x") is a partition of the coordinate x and g is a positive rational 
number such that 1/g G N and 

/2f(tx',tV)=t^V2';'(x,x") all t>0. 

We define the type of the maximum point /x^ as the minimum d such 
that fl^l{^ - /xP) 7^ as X 7^ and flf^{^ - /x^) = for j = 1, . . . , d - 1. 

We observe that when q = \ the expression (12.281) is the Taylor expan- 
sion of the function /. In this case fcp is called the homogeneous type of the 
maximum point /x^. In particular if a maximum points ii^ has homogeneous 
type equal to 1, around /x we have: 

/(x) = /(a*^) + i(:KK/x^)(x - /x^), (x - /x^)) + o(||(x - /x^)2||) 

where IK/(/xP) is the Hessian matrix of / computed in the maximum point 
[i^ . We define the maximal type k* of the function / as the largest of the k^. 
Define the function 

i?(x;y) = /(x + y)-/(y). (2.29) 

For each p = 1, . . . , P if /x^ is a maximum point of homogeneous type k^ 
there exists 5^ > sufficiently small so that, as — )■ oo for ||x/N^/^'^''|| < 5p 

(2.30) 

^■^(i^.M') < i/£'(^) +"(l)A..«(x) 
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where N = {Ni, . . . , A^„), a. = (ai, . . . , «„), P2fcp(x) is a polynomial of 2kp 
degree and P2fcp+i(x) is a polynomial of 2kp + 1 degree. 

Now we can state our main results. The following describes the thermo- 
dynamic limiting distribution of the random vector of magnetizations. 

Theorem 2.3.1. Consider a system described by the mean-field Hamiltonian 
Hn = —Ng{mi{(T), . . . ,mn{cr)) where g is the convex function defined in 
112. ()\} . Let fi^, . . . , fi^ be the global maxima points of homogeneous maximal 
type k* of the function f given by \2.21\) . Then as N oo 



(mi(cr), . . . , mn{cr)) — 



f:6p5(x-M^) 



p 



where 6, 



The following theorem solves the problem of the correct normalization of 
the random vector of the sums of spins whenever the function / admits a 
unique maximum point. 

Theorem 2.3.2. Consider a system described by the mean- field Hamilto- 
nian Hjs[ = —Ng{mi{(T), . . . , m„(cr)) where g is the convex function defined 
in h2.b]) . Let ^t = (/ii, . . . be the unique global maximum point of the 
function f given from 1^2.27^ . Let k be the homogeneous type of the maxi- 



mum point. 

1. If k = 1 the asymptotic behaviour of the random vector 
gi. ^ _ / 'S'i(cr) - Nifii Snjcr) - Nnjln 

VNl 



(2.31) 



as Ni — i- oo, . . . , Nn ^ oo, for fixed values of ai, . . . , an, is given by a 
normal multivariate distribution whose covariance matrix is: 
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X 



dh2 dhi 



dni (9/i2 
dh2 dhi 

dho 



dfii 


dfln\ 


OK 




<9/i2 




dhn 


dh2 



\V dhn dhi V dh 



dni dun Id^i2 dun 



dfJ-n 

dhr, 



(2.32) 



2. If k > 1 the asymptotic behaviour of the random vector 

'Si{cr) - Nifii Sn{cr) - A^„/i^ 



as Ni — )• oo, . . . 

proportional to: 



(2.33) 



A''^ — )■ oo, for fixed values of ai, . . . , an, has density 



where a 



The following last theorem handles the case in which the function reaches 
the maximum in more than one point. 

Theorem 2.3.3. Consider a system described by the mean-field Hamiltonian 
Hjq = —Ng{mi{a), . . . ,mn{cr)) where g is the convex function defined in 
112. 6\} . Let fi = {fii, . . . , fin) be a nonunique global maximum point of the 
function f given from l[2.21\) . Let k be the homogeneous type of the maximum 
point. Define 6 to be the minimum distance between all distinct pair of global 
maximum points of the function f . 

Then for any d G (0,5) when the random vector of the magnetizations 
(mi(cr), . . . , m„(cr)) is inside the ball B{fi, d) centered in fj, of radius d 

1. if k = 1 the asymptotic behaviour of the random vector S^{cr) defined 
in Ii2.31\) as Ni — )■ oo, . . . , — )■ oo, for fixed values of ai, . . . , a„, is 
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given by a normal multivariate distribution whose covariance matrix is 
given by 112. 32\] : 

2. if k > 1 the asymptotic behaviour of the random vector Skier) defined 
in ^2. 33\) as Ni — )■ oo, . . . , Nn oo, for fixed values of ai, . . . , an, 
has density proportional to: 

where (x = (ai ,...,«„). 

The proofs of theorems 12.3.1^ 12.3.21 and 12.3.31 need the following results. 

Lemma 2.3.4. Suppose that for each N, X^v = (-^tvi, • • • ,^Ni) and = 
(Y/Vi, • • • , ^Af„) o^e independent random vectors. Suppose that X^v weakly 
converges to a distribution v such that 



[ e*<"'^>rfz/(x) ^ for all r G 



Then Yjv weakly converges to /i if and only z/X^r + Y^r weakly converges to 
the convolution u * fi of the distributions v and fi. 

Proof. Weak convergence of measures is equivalent to pointwise convergence 
of characteristic functions. □ 

Lemma 2.3.5. Let A = DqJDq, be a positive defined matrix where the 



matrix Dq, = diag{y/ai, . . . , y/a^} and the matrix J is defined in \2. 
Given the random vector {Wi, . . . , Wn) whose joint distribution is the normal 
multivariate 

detA\^ f I,, A , , 

exp --(Aw,w) (2.34) 



(27r)"7 ' \ 2 

if [Wi, . . . , Wn) is independent of{Si{(T), . . . , S'„(cr)) then for (mi, . . . , m„) G 
M" and 7 G M the joint distribution of 

W, Wn \ ^ fS,{(T) - N,m, Sn{(T) - iV„m„ 



(A^i) 1/2-7 ' ■ ■ ■ ' (iv„) 1/2-7 J ' y (iVi)i-7 ' ■ ■ ■ ' (iv„)i-^ 

(2.35) 
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is given by 



exp (n f (^-^ + mi, . . . , ^ + niny^dxi . . . dxr^ 



+ mn] ] dxi . . . dxn 



(2.36) 



where f{xi, . . . is the function defined in 1^2. 21\). 



Proof. Given 6i, . . . ,6^ real 



^. Wi Si{(T)-Nimi Wn 5„(cr)-Ar„m„ 

-T < TT^TTTT; 1 TTTT-. S f^l,. . . , TT^TTT; 1 TT^T-; ^ Or 



(A^i) 1/2-7 {NiY-^ 



= P I V^H^l + Si{(t) G ^1, . . . , ^/WnWn + Sn{(T) G 

where Ei = (— oo, {NiY~"'9i + Ninii]. The distribution of the random vector 
(yiVil^i,...,v^WO is 



detA\2 / I,. , 
exp y - -(Ax,x) 



(2vr) 



(2.37) 



where it is easy to verify that A = 1/A^J. We claim that since the matrix 
A is positive define also A has this property. The joint distribution of the 
random vector (S'i(cr), . . . , Sn{cr)) is: 



■exp ( -^(Js,s) + (h, s) )(iz/5'(s) 



Z;v(J,h) ^ \2N 



(2.38) 



where ^'s'(s) is the distribution of (S'i(cr), . . . , S'„(cr)) on (K^, Hili Pl*^*))- 
The distribution of the random vector fl2.35p is given by the convolution of 
the distribution fl2.37|) with the distribution (12. 38 p . 
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Thus: 



p[^/N;W^ + S,eE,,...,^/N;,Wr, + SneE^^ 



1 /detA 



X 



1 



- (J(w - s), (w - s)) + (Js, s)) + (h, s)^ dus{s)d:^ 



Zjv(J,h) V(27r) 



det A\ 2 



i=i ' 



where ^ Ei denotes the Cartesian product of the sets Ei. 
1=1 

Since 



;=1 •^'^^^ ^ i€Pi ^ p=l ^ ^ iGP; 

= IT n / ( ( + 4 XI -^'P^P ) ) ^^(^0 

making the foUowing change of variables 



_ wi - Nimi _ 



and integrating over s, we obtain: 
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1-7 



(=1 



Z^(J,h) V(27r)" 



det A\ 2 



X / . . . / exp ( - — > aiapJip ( +mi]( + mp ) + 



n n \ 

+ ^Ni\n(^ cosh ^/i; ^ apJip {^-^ + mp j j j j c/xi . . . c/x^ 



1-7 



«=1 



det A\ 2 



Z^(J,h) V(27r 



y ... j exp (Nf(^-^ + mi, . . . + THnyjdxi . . .dxn- (2.39) 



Taking 6*1 — )■ oo,...,6'„ — )■ oo the (12.391) gives an equation for Z7v(J,h) 
which when substituted back yields the result (12.361) . The integral in the last 



expression is finite by (12.221) . □ 

We remark that as 7 < 1/2, the random vector {Wi, . . . , Wn) does not 
contribute to the limit of (12.361) as A^i — )■ 00, . . . , A^„ — )■ 00. 

Lemma 2.3.6. Defined F = max{/(x)|x G M"}, let V be any closed (possi- 
bly unbounded) subset o/M" which contains no global maxima of the function 
f defined in I2.27[ Then for any t G M" there exists e > such that 



[ exp(Ar/(x) + (t, N^x))rfx = 0{e-^') N ^ 00. (2.40) 

Jv 
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Proof. V contains no global maxima of /(x), thus there exists e > such 
that: 

sup /(x) < sup /(x) — e = F — e. 

Pick M > so large that for every A^, whenever ||x|| > M 

iV/(x) + (t,N^x) < -^iV(Jx,x) < -i(Jx,x) 

we can write 

^-NF [ g7V/(x)+(t,N^x)^^ 



V 

= e-^^ ( I e^^W+<*'N"''>t/x + / e^^W+<*'N'''>rfx 

V ivn{||x||>A/} Jvn{||x||<Af} 

<e-^^ / e-^<-^'''''>rfx + e-^^e-^^"e^^"'^ll*ll / rfx. 

iyn{||x||>M} iyn{||x||<M} 

(2.41) 

Since -F > /(O, . . . , 0) > and J is positive define the latter passage of f l2.4ip 
as — )■ oo is 0{e~^'^) where e = min{F, e}. This proves the fl2.4Up □ 



Lemma 2.3.7. Let fi be a global maximum point of the function f given by 
1^2.27^ . Let k be the homogeneous type of ^i. Define F = max{/(x)|x G M"}. 



Then there exists a positive number 5^ such that for any t G M", any /c G N, 
any 6 G (0, 6^] and any bounded continuous function : M" — > M 

= 0(M)£exp(/-(-^ 



t,x) c/x. (2.42) 



Proof. To make the notation easier we define 7 = l/2k. Making the change 
of variable 

xi=IJ-i + — 1 = 1, ...,n 
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the left-hand side of fl2.42p becomes 

where B is the function defined in f l2.29p . By the conditions expressed in 
f l2.30p and the dominate convergence theorem the limit fl2.43p is equal to 

0(m) £ exp (^/^t (^) + (t, u)^ du. (2.44) 

Since fl^ki'^^nk) < every x different from zero, the integral in f l2.44p is 
finite. This completes the proof of the lemma. □ 



Proof of Theorem \2.3.1\ By definition mi{a) = Si{(t)/N, thus by lemmas 
12.3.41 and 12.3.51 (with 7 = and m = 0) we know that consider a random 
vector {Wi, . . . ,Wn) whose distribution is the multivariate Gaussian given 
by fICTD . if (1^1, ... , Wn) is independent from (5i(o-), . . . , S'„(cr)) the distri- 
bution of 




is given by 

exp(Ar/(x))dx 



exp(Ar/(x))cix 



Thus to prove the theorem it is enough to show that for any bounded con- 
tinuous function 6 : M" — i- M 



' '-^p ■ ^2.45) 

/ e-/Wcix ^ 

Consider 6i,...,6p such that conditions given in f l2.30p are satisfied. We 
choose 6 = min{5p \ p = 1, . . . , P} decreasing it (if necessary) to assure that 
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< 6 < mm{\fi^ — /x^l : 1 < p 7^ g < P}. Denoted by V the closet set 

p 



p=i 



where B{fj,p,6) is the ball centered in fj,^ of radius 6, by lemma 12. 3.61 with 
t = there exists e > such that as — )■ 00 



^-NF / eA^/(x)^(x)^^ ^ 0(e-^^). (2.46) 
Jv 

Moreover, for each p = 1, . . . , P by lemma [2.3.71 we have 



= '^(M^)/exp(/,f.(^))dx. (2.47) 

By fl2:i6D and (12:^71) we get 

= 5^0(a.-) /exp(/,';^.(-^))rfx. (2.48) 

In a similar way for the denominator we have: 
hm iWNY'e-''^ / e^^Wrfx 



Af-s>oo 



i:/-p(/£(^))<'x. (2.49) 



Now the statement iHJ^ follows from ([23HD and ([232]) • □ 
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Proof of Theorem \2.3.^ For A; > 1, by lemmas [2331 and EXS] (with 7 = I /2k 
and m = /x), we have to prove that, for any bounded continuous function 

: R" M 



To make the notation easier we set 7 = l/2k. We pick 5 > such as 
conditions (l2.3Up are verified. Defined F = f{fi), by lemma 12.3.61 with t = 
there exists e > so that 



TV/ (-|^ + /x) U(x)rfx = O ( ( n iV/) 'e-^^) . (2.50) 
— • ^ 1=1 



On the other hand 



I exp(iV/(^ + Ai)')^(x)rfx 

1^ ^^exp(iVi?(^,/x)^^(x)dx. (2.51) 



^_Ar(F-/(;x)) 



Thus by conditions fl2.30p and the dominated convergence theorem the right- 
hand side of fl2.5ip as — ?■ 00 tends to 



This with (12.501) proves the statement (2) of the theorem. 
We observe that for k = 1 the following identity holds 



^•/2t(^)=-^(-^C/(M)x,x) 



where [K/ = D^^IK/D-i is a negative define matrix. Following a similar 
procedure, by (I2.30p and the dominate convergence theorem, we prove that 
for any bounded continuous function t/^ : M" — > M the ratio 
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converges to 



The multivariate Gaussian obtained 

( (2^)n J exp(--(-IK,(M)x,x))cix 

is the convolution of the distribution of the random vector (W^i, . . . , Wn) with 
the distribution of the random vector S^(cr) given by (12.311) . 

Indicated with ^wl-^), ^s^l-^) ^"^^ ^w+s^l-^) respectively the characteris- 
tic function of the random vectors (H^i, . . . , W^n), of the random vector fl2.3ip 
and of their sum the following equality holds: 



0w+si(A) = 0w(A)0si(A). (2.52) 

We remember that the characteristic function of a random vector (Xi, . . . , X„) 
whose joint distribution is a multivariate Gaussian 




is 0(A) = exp(— 1/2(B^^A, A)) where is the covariance matrix of the 

vector (Xi, . . . ,X„). 

Thus the equality (I2.52p allows to determinate the covariance matrix of 

the vector S^(cr) taking off the matrix from — ^Kj . By calculus it is 

~ -1 _ _ 
easy to verify that — IKr — A — X- 
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To complete the proof we have to show that the matrix x is positive 
define. Considering the convex function 

. . . ,Xn) = ^ai\n I cosh f ^ agJisXs + ) 

1=1 ^ ^ s=l ^ / 

1 " 

= f{xi, . . . , Xn) + - ^ aiasJisXiXs (2.53) 

«,s=l 

we can write IKj = IK$ — DqDqJDqDq where IK$ is the Hessian matrix 
of the function $. Since A = DqJDq, we get —IK/ = A — IK$ where 
= D^^IK$D~^. Multiplying x by the positive define matrix —IK/ we 
obtain 

-^C/(m)x= (a-^C$(/x))((a-^C$(m))"'-A-i) =^C$(/x)A-\ (2.54) 

Since all matrices involved in f l2.54p are symmetric and IK<^>(^t)A~^ is posi- 
tive define it follows that also x is positive define. Hence the random vec- 
tor fl2.3ip . converges to a multivariate Gaussian which covariance matrix is 
X- □ 

In order to prove theorem 12.3.31 we introduce the conditional joint distri- 
bution of a configuration cr conditioned on the event (mi(cr), . . . ,m„(cr)) e 
B{fi,d) 

P^'^'^'^^^^ = Z^(jlh,d) ^"P (2^^-^^'^^ + (h,s))l^(,,.)(^)rf.,(s) 

(2.55) 

where lB{fj,,d) is the indicator function of the ball B{fi,d), us denotes the 
distribution of the random vector (5*1(0-), . . . , Sn{cr)) on (M^, YliLi Pi'^i)) 
Zn{J ,h.,d) is the normalizing constant. 
We also need the following results: 

Lemma 2.3.8. Let PN,3,h,5{(^} be the joint distribution of cr = (cti, . . . , a^). 
Let be the random vector 

Wi Wn \ Si{a) - iVimi 5„(o-) - A^„m„ 



(iVi)i/2-7'---' (Ar„)i/2-7y ' (Ari)i-7 (iV„,)i-^ 

(2.56) 



2.3 Asymptotic behaviour of the sums of spins 



57 



where W ~ -/V(0, A ^) and A = Dq, JD^ is a positive define matrix. 
Then 



(2.57) 

where {■)BGd denotes the expectation value with respect to the conditional 
distribution /i2.55\) and 



g-(t,N^M>j 


f / N ~ 

1 exp -— (Jx,x) + (t,N 




|/Ar(x, /X, d)dyi 


J 


f exp(--(Jx,x) + (t,N^x)) 




X, fi, d)d'^ 



/Ar(x, /i, d) = / exp((jQ;x, s) + (h, s))(iz/5(s). (2.58) 

Proof. By following the same proof of lemma 12.3.51 we have that the distri- 
bution of the random vector is given by 

where 
Thus 



l'"K-Y(^('' + i?7)'''+I^))''" 

Making the change of variable 



Ui = + 1 = 1, 



the statement fl2.57p holds. □ 
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Lemma 2.3.9. Let be global maxima points of the function f 

given by \2.21\) . Let ki, . . . ,kp be their homogeneous type. Define 



K^{t, 5, ^, fc) = ( n Ni) " exp(-iVF - (t, N^/^V)) 



1=1 



where 



N 



XI exp - — (Jx,x) + (t,N^x))/^(x,/i,^)o!x (2.59) 

B(p,S) ^ ^ 



exp((jQ;x, s) + (h, s))diys{s) 



{^ei?-(M,e)} 



(2.60) 



For any 9 > there exists e > such that for each p = 1, . . . , P 



(2.61) 



Proof. We prove the theorem for p = 1. The proofs for other p are similar. 
We observe that 



n 

1=1 

n 

=u 

1=1 



Slier) 



Ni 

Slier) 



f^i 



> 9 



N, 



Slier) 



N, 



> 



f^i 



where 6 = ^JnQ. Thus 



/^(x,m\^)<XJ(^ 



+ 



exp((jQ;x, s) + (h, s))(iz/5(s) 
exp((JcKX, s) + (h, s))c^z/s(s) ) . (2.62) 
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Consider one of the integrals of expression (12.621) 
/ exp((Jax, s) + (h, s))diys{s) 

n n 
J]^ cosh ^ ^ agJlqXq + hi 



''I 

1=2 ' q=l 



X 



» n 

/ exp ( gi (cr) ( aqJiqXq + hi]] T]dp{ai). 



By Chebishev's inequality for any r > 

p n 

I exp ( 5*1 (cr) ( aqJiqXq + hi)) TT dp{ai) 

< exp(-aiJiiriVi(^i + 9)) 

X / exp(aiJiir ^ (Ti) exp(^ cri(ai JiiXi + a2Ji2a;2 + ^i)) 
■^^'^'^ iePi iePi 

= exp(iVi(-a;i Jiir(yU^ + 9) + In cosh(Q;i Jii(xi + r) + a2</i2a;2 + ^i)))- 

(2.63) 

By the mean field equations (12.191) we have: 

^lncosh(aiJiiXi + «2-^i2a;2 + hi)^ (fi^) = ai Jn/i^. 
Thus we can choose 6 > and r > sufficiently small such that 6 < 6i and 

lncosh(Q;i Jii(xi + r) + a;2Ji2a;2 + hi) 

< In cosh(Q;i Jiia;i + a2Ji2a;2 + ^i) + ctiJufilr + -aiJuT9 (2.64) 

for each x G B{fi^,6). The other integrals in (I2.62p are handled in a similar 
way. At last applying the bounds (I2.63P and (I2.64p to (I2.62p . for all x G 
B{iJ,^,6) we obtain: 

/^(x, fi\ 9) < 2nexp (^n(^ - ^alJnr9 + <l>(x; 
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where $ is given by (12.531) . Hence 
KN{t, 5, fJ^\e, h) < 2n{Nif''^^^ exp {^-NF- (t, N^/^fci^i^ _ j^^^^ 
X ! exp(A^/(x) + (t,Ni/2fcix))t;x. (2.65) 

Applying the lemma [2.3.71 to the right-hand side of (I2.65P we obtain 

iriv(t,5,At\^,A;i) = 0(e"^"?-^""^") as iV ^ 00. (2.66) 
We now bound 

= {Niy/^''' exp{-NF - (t, Ni/2fei^i^) 

/ exp ( - -(Jx, x) + (t, Ni/2'=ix))/^(x, fi\ 9)d^. 



X 



Considering the functions Ijy and given respectively by (I2.58P and (I2.60p . 
it is easy to verify that: 

J^(x, ^i\e) + /^(x, fi\ 6) = exp(iV$(x)). (2.67) 

Thus: 

J^(x,At\^)<exp(iV$(x)). 
By definition of the function $ we get 



X 



exp(A^/(x) + {t,N^/^'''x))dx. 

B{,i\Si)^B{tJ.\d) 



Making the change of variable 
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we obtain 



where 



E 



u 



Observing that 



Nl/2A:i 



E C 



<Si\\ 



u 



u 



]\[l/2fci 



< 6 



< 6 



it follows that as — )■ oo, for some ep > 

The statement flTO]) follows by (ESS]) and ( 1238|) . 



(t, u) c/u 



(2.68) 
□ 



Proof of Theorem \2.3.'d We give the proof for /x = /x^. The other global 
maximum points are handled identically. Fix t G we choose the number 
5p > 0, p = 1, . . . , P according to lemma 12.3.71 For all 5 G (0, 5p\ 



-£-p(<(^) + (t,x)).x (2.69) 



Since = 5(/x\ (5i) U fi^(/x\ 5i) and /iv(x, /xS 5) = e^*W - /^(x, 5) by 
lemma 12.3.81 after have multiplied numerator and denominator by the term 
(nr=i^/)'/'^'e-^^ we obtain 



(e 



(t,v 



l/2fei/ 



LAf(t, ^1, ki) - -gAr(t, ^1, d, ki) + MAf(t, ^1, fci) 

L;v(0, 5i, ki) - Kn{0, 5i, d, ki) + M7v(0, 5i, ^i, d, ki) 
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where the random vector Yi/2ki is defined by (12.561) . the function is 
defined by (ICTjl . 



L^(t,5i,/x\A;i)= (n^'j exp(-iVF-(t,Ni/2/c,^i^^ 
1=1 

X / exp (- — (Jx,x) + (t,Ni/2fcix^ ^ 

/ " \ l/2fci 

(Ha^/) exp(-iVF-(t,Ni/2/c,^i^^ 
exp(iV/(x) + (t,N^/2'=^x))rfx 



X 



and 

= ( n ^0 exp(-iVF - (t, Ni/^'^^i)) 
z=i 

X / exp ( - — ( Jx, x) + (t, N^/2feix) ) /Ar(x, /X ,(i)(ix 

By lemma 12.3.91 (with p = 1 and 6 = d) there exists ei > such that 

ir^(t,5i,M\rf,A;i) = 0(e-^^^). (2.70) 

Now we prove that there exists also e2 > such that 

M;v(t, 5i, d, h) = 0(e-^^^). (2.71) 

Define the closet set 

p 

p=i 

Then 

p 

p=2 
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Thus we can write 

M^(tA,/x\rf, h) 

= (nA^/)'^'''exp(-iVF- (t,N^/2A,^i^) 
1=1 

X / exp(-—(J^,^) + {t,-N^/^'''^))IN{^,^l\d)d^. 

(2.72) 

Since d < S and — > S for p = 2, . . . , Pwe have B{fi^,6i) C 
B'^{IjP, 5 — d) hence for each x e M" and p = 2, . . . , P 

lN{^,fi\d)<P^{^,tiP,6-d). (2.73) 

Moreover by (12.671) 

IN{^,^l\d)<exp{N^^)). (2.74) 

Using fl2.73p in the integrals over B{^^, 6p), p = 2, . . . , P and (12.741) in the 
integral over V of the expression (12.721) . we obtain 

MM{t,Si,f^\d, ki) 

/-A- \ l/2fci 

= [llNi) exp(-iVF- (t,NV2fc^A*i)) 

1=1 

X [ exp(iV/(x) + (t,Ni/2'=^x))(ix 
Jv 
p 

+ ^ exp ((t, NI/^'^Hm^ - M')))^^(t, M^, 5 - d, h). (2.75) 



Applying the lemma 12.3.61 to the first term of the right-hand side of (I2.75P 
and lemma 12.3.91 to each term of the sum, the result (I2.7ip holds. 
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By (12^0]) and fl2TB it follows 



where in the last identity we use f l2.69p . By the assumption on the random 
vector W the theorem 12.3.31 is proved. 



Chapter 3 

The Inverse Problem 



So far we have seen that once the probabihty distribution of a configu- 
ration of spins is assigned it is possible to compute the Gibbs state in the 
thermodynamic hmit of any observable of interest and to related them to the 
parameters of the model. 

Now we want to analyze the inverse problem, that is the determination 
of the parameters of a Boltzmann-Gibbs's distribution knowing the average 
value and the correlations of the spins at the equilibrium. 

We solve the inverse problem for the Curie- Weiss model as well as for its 
multi-species generalization with naive-mean-field method. This technique 
is used in |Tan98|lRTH09|.[RAH09] to solve the inverse problem for the Ising 
model. 

3.1 Inverse problem for the curie- Weiss model 

We recall that the model of Curie- Weiss is defined by the Hamiltonian 
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and the distribution 

N 

ZN{J,h) .^^ 
where 



PN,j,h{(^} = — 7 (T h\ — ii^py^i) (3-1) 



p{x) = l[6ix-l) + 6ix + l)). (3.2) 

By (13. 2p and the definition of magnetization the distribution (13.11) can be 
written as 

p J X exp(-i/^(<T)) 



qxp{-Hn{(t)) 



exp (^jm%{cr) + hmN^cr)^ 
J2 exp (^N (^jm%{a) + /im7v(cr))^ 



(3.3) 



where Qn = {-1, 1}^- 

Since {rriN^cr)) bg = {<^i)BG for each z = 1,...,A^ to solve the inverse 
problem we have to know the average value and the variance of the magne- 
tization with respect to the Boltzman-Gibbs measure (13.31) . 

As h and J > or h = and J < 1, by theorem 11.3. II the following 
equality holds 

lim {mN{a))BG = (3-4) 

TV— s>oo 

where /i is a solution of the mean-field equation (11.571) that maximaze the 
function / given by (ll.56p . Differentiating the identity (13.41) with respect to 
h we obtain: 

d 

N^oc ah 
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where by definition x = d^/dh and 



d. , _ 9 /E<T6f7^."^Jv(o•)exp(-/7^(<T)) 



E<TeCiv exp(-if^(o-)) 
A^(«('^))BG-(m;v(^))lG)- (3.5) 



On the other hand we have seen that 

^ = 1-J(1-/.^)- ^'-'^ 

Thus by (13 .Sp and (13. 6 p in the thermodynamic limit we can compute the 
parameter J from the average value and the variance of the magnetization: 



Determinate J, we obtain an espression for the field h, in the thermodynamic 
limit, inverting the mean- field equation 

h = tanh~^((mAf(cr))BG) - J{mN{cr))BG (3.8) 

where J is given by (13. 7p . This solve the inverse problem for the Curie- Weiss 
model as /i 7^ and J > or h = and J < 1. 



We have seen that iih = and J > 1 the function / reaches the maximum 
in two different points ±/io both of maximal type. Thus the identity (13. 4p 
is not verified. In spite of it we can solve the inverse problem observing 
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that there exixts e > such that whenever niN^cr) G (±/io — e, ±/io + e) the 
foUowing holds 

lim {mN{(T))BG = ±Ato (3.9) 

and then applying to (13.91) the same procedure we have shown. 

The inverse problem is very useful when we deal with the phenomenolog- 
ical test of the Curie- Weiss model. In this case we would like to estimate the 
unknown parameters J and h of the distribution of Boltzmann-Gibbs from 
a sample of empirical data. One possibility to reach this aim is to use the 
maximum likelihood estimation. This method determinates the parameters 
that maximize the probability to obtain the given sample under the condi- 
tion that the sample is the realization of random variables indipendent and 
identically distributed. 

Since the spins of a single configuration cr are dependent, to apply the 
maximum likelihood estimation we have to consider a sample constituted 
by M configurations of spins cr^^\ . . . , cr*^*^) indipendent and identically dis- 
tribuited according to the Boltzmann-Gibbs measure f l3.3p . Our aim is to 
maximize with respect to J and h the joint probability of the sample 

The function L{J,h) is called maximum likelihood function. Since the sam- 
ple is indipendent and identically distributed we have 



exp(-i7A.(cr(-))) 



m=l 
M 



n 



1 E,rGn^exp(-ifjv(cr))' 



To maximize the function L{J,h) we should compute the derivative of a 
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product. Since a function and its logarithm reach the maximum in the same 
point we consider the logarithm of the maximum likelihood function 

lnL(J,/i) = ^('-i7^(o-(™))- expi-H^icT)] 

m=l ^ (tGSIjv 



and differentiate it with respect to h and J: 



d\nL{J,h) 
dh 



E<Tec^ exp(-ffjv(cr))m7v(cr) 



M y 

;^iV E<.gn^exp(-/7jv(o-)) 

m=l ^ ^ 



d\nL{J,h) 
dJ 



M 

E 

m=l 
M 



N 



(m) ^ 



N\ 



2 E.exp(-if^(cr)) 



m=l 



AT 



(-AT 



^ , 2 . N\ 



These derivatives are equal to zero as the following equalities hold 



(jnN{(T))BG 



{m\{(T))BG 



\ M 



1 M 



(3.10) 



Thus the function L{J,h) reaches its maximum when the average value and 
the variance of the magnetization are calculated from the data according to 
fl3.10p . Once we have compute these values, appling the procedure explained 
above to solve the inverse problem we obtain that the maximum likelihood 
estimators for J and h are given respectively by (13. 7p and (13. 8 p where the 
average value and the variance of the magnetization are computed from the 
data according to (I3.10p . 
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3.2 Inverse problem for the multi-species mean- 
field model 

The inverse problem for the multi-species mean field model is handled in 
a similar way. Suppose to know the average value and the correlations of the 
magnetizations of a model defined by Hamiltonian 

l,s=l 1=1 

and distribution 

exp(-ij'jv(o-)) 1^ 
PN,j,h{(^} = — ijc^Pl^^*) (3.11) 

where p is given by fl3.2p . We recall that by the definition of the measure p 
the distribution fl3.11|) can be write as: 

_ exp(-gjv(cr)) 
2^ exp(-i^^(cr)) 

If the function / defined in f l2.2ip has a unique maximum point ^t = {pi, . . . , pn) 
of maximal type, by theorem 12.3.21 the following identities hold: 

Urn {mi{a)) BG = fJ'i l = l,...,n. (3.13) 

N^oo 

Differentiating the identities fl3.13p with respect to hg, s = 1, . . . ,n we obtain 

d 

T^{^li^))BG = Xls l,S = l,...,n 

where xis are the elements of susceptibility matrix. In particular 
dpi d 



Xls 



tanh {hi + ^ apJipp^^ 



dhs dhs 

p=i 



1 - tanh^ {hi + ^ apJipPp^ j {Sis + ^ J/p 
p=i 

n 

1 - At?) ((^/s + ctpJipXps^ 



dhs 

p=i p=i 



p=i 



3.2 Inverse problem for the multi-species mean-field model 



71 



where Sis denots the delta of Dirac picked in / = s. Thus the susceptibility 
matrix can be write as: 

X = P(I + JD«D«X) (3.14) 



where P = diag{l — /if, . . . , 1 — /i^}, Dq, = diag{y/ai, . . . , a/o^}, I is the 
identity matrix and J is the reduce interaction matrix. Moreover, for each 
I, s = 1, . . . ,n 

^ -{mi{cT))BG 



dhs 



= Ns(^{mi{a)ms{cr)) BG - {m{cr)) BG{ms{(T)) bg^ ■ (3.15) 

Computing the elements of x according to fl3.15p by fl3.14p we get an expres- 
sion of the reduced intaraction matrix J related to the average value and the 
correlations of the magnetizations: 

J = (P-^ - X-')D-iD-\ (3.16) 

Once the matrix J is determinated, the elements of the vector h are obtained 
inverting the mean field equations fl2.19p 

n 

hi = tanh"-^(/ii) - ^ asJisfis / = 1, . . . , n. (3.17) 
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In the previous section we have seen that the inverse problem together 
with the maximum likelihood estimation avoids to measure the parameters of 
a Boltzmann-Gibbs's distribution from a suitable sample of empirical data. 

Consider a sample of M configurations of spins cr'^^\ . . . , cr*^*^) indipen- 
dent and identically distribuited according to the Boltzmann-Gibbs measure 
f l3.11|) . The maximum likelihood function related to the sample is 



M 



m=l 

M 



^ expf-ff^(<T(™))^ 



m=l 

Differentiating the logarithm of the likelihood function fl3.18p 
In L{3, h) = J2(- HNicT^""^) - In Zm{J, h)] 

m=l ^ ' 

with respect to hi and Jj^, Z, s = 1, . . . , n we obtain 

M 



91nL(J,h) _ ^ '^m;(cr(™)^ - exp(-gjv(<T))m;(cr) 



m=l ^ ^ 



(91nL(J,h) NaiUs 



dJi 



Is 



IVl / 

m=l ^ 

Yjct exp(-i^7v(cr))m;(cr)ms(cr' 



m=l 



^iv(J,h) 

) - {mi{(T)ms{(T))BG 
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These derivatives are equal to zero as the following equalities hold 



I M 

{mi{cT))BG = V7 E mi{a("^^) I = 1, 

IVl rn=l 



I M 

{mi{(T)ms{(T)) BG = 77^ m/(cr("'))ms(<T("')) l,s = l,...,n. 



(3.19) 



Now applying the inverse problem we obtain that the maximum likelihood 
estimator for the reduce interaction matrix J and the vector field h are given 
respectively by fl3.16p and flS.lTp where the average value and the correlations 
of the magnetizations are compute from the empirical data according to 
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